Stretchable display device and operating method thereof

ABSTRACT

A stretchable display device including a display unit configured to be stretched in at least one direction; a sensing unit configured to sense information on a stretching force applied to the display unit; and a controller configured to stretch the display unit an amount corresponding to the stretching force applied to the display unit, stretch an entire area of the display unit in response to the stretching force being applied to the display unit without an area designation input for designating a partial area of the display unit to be stretched, and stretch the partial area of the display unit in response to the stretching force being applied to the display unit with the area designation input being applied to the display unit.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority under 35 U.S.C. 119 and 35U.S.C. 365 to Korean Patent Application No. 10-2015-0040116, filed onMar. 23, 2015, which is hereby incorporated by reference in itsentirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present disclosure relates to a display device and an operationmethod thereof.

2. Discussion of the Related Art

Deformable display devices such as folded, rolled in a roll type, orstretchable in at least one direction are being researched anddeveloped. Since these displays are deformable in various types, displayenlargement and display miniaturization are requested. Furthermore,because the display device is deformable, efficiently displayinginformation is needed.

SUMMARY OF THE INVENTION

Embodiments provide a stretchable display device capable of beingstretched only with a simple operation according to a user's request.

Embodiments also provide a stretchable display device capable ofobtaining a stretch criterion according to a direction of an appliedforce or a specific input, and stretching a display unit according tothe obtained stretch criterion.

Embodiments also provide a stretchable display device capable ofimproving user's convenience by stretching a display unit to displayhidden information before the stretch or by stretching the display unitfor enabling information displayed before the display unit is stretchedto be enlarged and displayed.

In one embodiment, a method of operating a stretchable display deviceincluding a stretchable display unit includes: obtaining a stretchcriterion that is a criterion for stretching the display unit on a basisof any one of a direction of a force applied to the display unit and anarea designation input for stretching a partial area of the displayunit; and stretching the display unit according to the obtained stretchcriterion.

In another embodiment, a stretchable display device includes: a displayunit stretched in at least one direction; a sensing unit sensinginformation on a force applied to the display unit; and a controllerobtaining a stretch criterion that is a criterion for stretching thedisplay unit on a basis of any one of a direction of a force applied tothe display unit and an area designation input for stretching a partialarea of the display unit, and stretching the display unit according tothe obtained stretch criterion.

Further scope of applicability of the present invention will becomeapparent from the detailed description given hereinafter. However, itshould be understood that the detailed description and specificexamples, while indicating preferred embodiments of the invention, aregiven by illustration only, since various changes and modificationswithin the spirit and scope of the invention will become apparent tothose skilled in the art from this detailed description.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will become more fully understood from thedetailed description given hereinbelow and the accompanying drawings,which are given by illustration only, and thus are not limitative of thepresent invention, and wherein:

FIG. 1(a) is a block diagram of a stretchable display device accordingto an embodiment of an embodiment.

FIG. 1(b) is a view illustrating a pressure sensor configuring a sensingunit.

FIG. 1(c) is a view illustrating a configuration of the display unit inwhich the sensing unit includes a plurality of acceleration sensors.

FIG. 2 is a flowchart illustrating an operation method of a stretchabledisplay device according to an embodiment.

FIGS. 3 to 10 are views illustrating various embodiments that when anarea to be stretched in an entire area formed by a display unit is notdesignated, the display unit is stretched according to a force appliedto the display unit.

FIGS. 11 and 12 include views illustrating various examples showinginformation provided while a display unit is stretched according to aforce applied to the display unit when an area to be stretched in anentire area formed by a display unit is not designated according toembodiments.

FIGS. 13 and 14 are views illustrating embodiments that when a directionof a force applied to a display unit is a z-axis direction, mediacontents provided on the display unit are zoomed in or zoomed out.

FIGS. 15 and 16 are views illustrating examples that a display unit in astretched state is fixed or returned to an original state according tovarious embodiments.

FIGS. 17 to 28 are views illustrating embodiments that when an areadesignation input is a touch input, a display unit is stretched based onan obtained stretch criterion according to various embodiments.

FIGS. 29 to 30 are views illustrating embodiments that when an areadesignation input is an input for selecting a content item, a displayunit is stretched based on an obtained stretch criterion according tovarious embodiments.

FIGS. 31 to 33 are views illustrating embodiments that a stretchcriterion is obtained through a touch pen, and a partial area of adisplay unit is stretched according to the obtained stretch criterionand a direction of an applied force.

FIGS. 34 to 35 are views illustrating embodiments that a stretchcriterion is obtained according to an input for bending the stretchabledisplay device, and a partial area of a display unit is stretchedaccording to the obtained stretch criterion and a direction of anapplied force.

FIG. 36 is a block diagram illustrating explaining a mobile terminalrelated to an embodiment.

DETAILED DESCRIPTION OF THE EMBODIMENTS

Reference will now be made in detail to the embodiments of the presentdisclosure, examples of which are illustrated in the accompanyingdrawings, in which like numbers refer to like elements throughout, and arepetitive explanation will be omitted. In the following description,usage of suffixes such as ‘module’, ‘part’ or ‘unit’ used for referringto elements is given merely to facilitate explanation of the presentinvention, without having any significant meaning by itself.

In addition, the accompanying drawings are used to help easilyunderstand the technical idea of the present invention and it should beunderstood that the idea of the present invention is not limited by theaccompanying drawings. This invention should not be construed as limitedto specific disclosure forms, and the spirit and scope of the inventionshould be understood as incorporating various modifications, equivalentsand substitutions.

Although the terms first, second, etc. may be used herein to describevarious elements, these elements should not be limited by these terms.These terms are only used to distinguish one element from another. Whenan element is referred to as being “connected” or “coupled” to anotherelement, it may be directly connected or coupled to the other element orintervening elements may be present. In contrast, when an element isreferred to as being “directly connected” or “directly coupled” toanother element, there are no intervening elements present.

As used herein, the singular forms “a,” “an” and “the” are intended toinclude the plural forms as well, unless the context clearly indicatesotherwise. Further, the terms “comprises”, “comprising,”, “includes”and/or “including”, when used herein, specify the presence of statedfeatures, integers, steps, operations, elements, components orcombinations thereof, but do not preclude the presence or addition ofone or more other features, integers, steps, operations, elements,components, or combinations thereof.

FIGS. 1(a) to 1(c) are block diagrams of a stretchable display deviceaccording to an embodiment. In particular, FIG. 1(a) is a block diagramillustrating a configuration of a stretchable display device 200according to an embodiment, FIG. 1(b) is a view illustrating a pressuresensor 211 configuring a sensing unit 210, and FIG. 1(c) is a viewillustrating a configuration of a display unit 250 in which the sensingunit 210 includes a plurality of acceleration sensors 213-1 to 213-4.

The stretchable display device 200 according to an embodiment is a nextgeneration display device to be realizable in a diverse and newenvironment since it is stretchable as well as flexible, unlike atypical display device realized only with a hard material such as glassor silicon. In other words, the stretchable display device 200 is adevice that is stretched when pulled, and contracted again to anoriginal state when released.

Referring to FIG. 1(a), the stretchable display device 200 may include asensing unit 210, a display unit 250, a storage unit 270, and acontroller 290. The sensing unit 210 may sense a strength and directionof a force applied to the display unit 250.

In an embodiment, the sensing unit 210 may include one or more pressuresensors. The one or more pressure sensors may be disposed in the displayunit 250. When the sensing unit 210 includes one or more pressuresensors, each pressure sensor 211 may detect a change in capacitance orresistance between both ends of an area to which pressure (i.e., force)is applied, as illustrated in FIG. 1(b). The pressure sensor 211 candeliver to the controller 290 any one or more of a capacitance changesignal representing a change of the detected capacitance or a resistancechange signal representing a resistance change. The capacitance changeor resistance change signal may include information on one or more ofstrength and direction of a force applied to the pressure sensor 211.The controller 290 can obtain one or more of a direction or strength ofa force applied to the display unit 250 by using the capacitance changeor resistance change received from the pressure sensor 211.

In another embodiment, the sensing unit 210 may include the plurality ofacceleration sensors 213-1 to 213-4 as illustrated in FIG. 1(c). Whenthe display unit 250 has a rectangular shape, each acceleration sensormay be disposed adjacent to each rectangular vertex. When the displayunit 250 includes a stretchable substrate and image display unit, theplurality of acceleration sensors 213-1 to 213-4 are disposed in thebottom end of the stretchable substrate and the image display unit maybe disposed in the top end of the stretchable substrate. However, thisis just an example and the plurality of acceleration sensors 213-1 to213-4 may be embedded the stretchable substrate or image display unit.

The acceleration sensor is a sensor detecting an acceleration or shockstrength when an object moves. When using the acceleration sensor, amovement state of the display unit 250 may be detected in detail. Theacceleration sensor may sense an acceleration of the display unit 250 ineach direction of three axes (i.e., x-axis, y-axis, and z-axis)perpendicular to each other. The controller 290 can obtain a movementvelocity by using three axis acceleration values measured through anacceleration sensor. The controller 290 can obtain a distance that thedisplay unit 250 is stretched in three axis directions by using theobtained movement velocity.

The controller 290 can obtain a direction and strength of a forceapplied to the display unit 250 by using the movement velocity andmovement distance obtained by using the acceleration sensor. Thecontroller 290 can stretch the display unit 250 according to theobtained direction and strength of the force.

The display unit 250 may be stretched and contracted in at least one ormore directions. The display unit 250 may include a stretchablesubstrate and image display unit. The stretchable substrate may beconfigured of a material of polydimethylsiloxane (PDMS) having a goodstretching characteristic and be stretched according to a pull force.The image display unit may be formed on the stretchable substrate andthe stretchable substrate may be stretched according to the stretchingof the stretchable substrate. The image display unit may display animage.

The storage unit 270 may store correspondence relationships betweenwhether to receive an area designation input, the direction and strengthof the force applied to the display unit 250, a stretch distance andstretch criterion.

The controller 290 can differently set the stretch criterion accordingto whether the area designation input is received. For example, when thearea designation input is received, the controller 290 can obtain thestretch criterion corresponding to the received area designation input,and stretch a partial area of the display unit 250 according to theobtained stretch criterion and the strength and direction of the appliedforce.

When the area designation input is not received, the controller 290 cansearch the storage unit 270 and obtain the stretch criterioncorresponding to a direction of a force applied to the display unit 250.The controller 290 can stretch the entire area of the display unit 250by a stretch distance corresponding to the direction and strength of theforce applied to the display unit 250.

Besides, the controller 290 can control an overall operation of thestretchable display device 200. An operation of the controller 290 willbe described below in detail with reference to drawings. The stretchabledisplay device 200 may include all elements of a mobile terminal 100 tobe described later with reference to FIG. 36.

Next, an operation method of the stretchable display device 200according to an embodiment will be described with reference to FIG. 2.In particular, FIG. 2 is a flowchart illustrating an operation method ofa stretchable display device according to an embodiment. The controller290 checks whether an area designation input is received for stretchingonly a specific area in the entire area of the display unit 250(operation S101).

The area designation input can be an input for obtaining a stretchcriterion that is a criterion to stretch only a partial area of theentire area of the display unit 250. The stretch criterion may beobtained according to the area designation input, and the partial areaof the display unit may be stretched according to a direction of anapplied force. This will be described later.

The area designation input can also be any one of an input for bendingthe display unit by applying a force to the display unit 250 and aninput for designating an area of the display unit 250 through a touchpen. A detailed description about the area designation input will beprovided later.

When the area designation input is not received (no in S101), thecontroller 290 checks the direction of the force applied to the displayunit 250 (operation S103). The controller 290 checks the stretchcriterion for stretching the display unit 250 based on the checkeddirection of the force (operation S105).

The stretch criterion may be a criterion for stretching the entire areaor the partial area of the display unit 250 in correspondence to theforce applied to the display unit 259. In an embodiment, the stretchcriterion may be varied according to whether the area designation inputis received through the display unit 250. For example, when the areadesignation input is received, the controller 290 can obtain the stretchcriterion according to the received area designation input, and stretcha partial area of the display unit 250 according to the obtained stretchcriterion and an applied force. As another example, when the areadesignation input is not received, the controller 290 can obtain thestretch criterion according to the direction of the applied force andstretch the entire area of the display unit 250. This will be describedin detail later.

The controller 290 stretches the display unit 250 according to theobtained stretch criterion (operation S107). Hereinafter, when the areadesignation input is not received, various embodiments in which theentire area of the display unit 250 is stretched according to a forceapplied to the display unit 250.

FIGS. 3 to 10 are views illustrating various embodiments in which thedisplay unit is stretched according to the force applied to the displayunit when an area to be stretched is not designated in the entire areaformed by the display unit. Hereinafter the display unit before thestretch is represented with a solid line and the display unit in astretched state is represented with a dotted line. It is assumed thatedges of the display unit lie in an x-axis or y-axis direction.

FIG. 3 is a view illustrating an example that the stretchable displayunit is stretched when a force is applied in a +x-axis directionaccording to an embodiment. Referring to FIG. 3, the controller 290 candetect a force applied to the display unit 250 and check the directionof the detected force. When the direction of the detected force is apositive x-axis (+x-axis) direction, the controller 290 can obtain asthe stretch criterion an edge or surface of the display unit 250, whichis perpendicular to the +x-axis and located −x-axis that is in anopposite direction to the +x-axis direction.

In more detail, when a force is applied in the +x-axis, the controller290 can set a reference line A1 at a first edge 251 or an extension lineof the first edge 251 is perpendicular to the +x-axis and located in a−x-axis that is perpendicular the +x-axis direction. The controller 290can stretch the entire display unit 250 by d1 in a +x-axis directionbased on the obtained reference line A1. The stretch criterion isdescribed as the edge of the display unit 250 in an embodiment of FIG.3, but is not limited hereto and may be a surface of the display unit250.

A stretch distance d1 by which the display unit 250 is stretched may bevaried according to the strength of the force applied to the displayunit 250. For example, the stretch distance d1 may be increased inproportion to the strength of the force applied to the display unit 250.In more detail, the stretch distance d1 may be increased as the strengthof the force applied in the +x-axis direction becomes greater.

Next, description is provided with reference to FIG. 4. In particular,FIG. 4 is a view illustrating an example that the stretchable displayunit is stretched when a force is applied in the −x-axis directionaccording to an embodiment.

Referring to FIG. 4, the controller 290 can detect a force applied tothe display unit 250 and check the direction of the detected force. Whenthe direction of the detected force is a negative x-axis (+x-axis)direction, the controller 290 can obtain as a stretch criterion an edgeor surface of the display unit 250, which is perpendicular to −x-axisand located in an opposite direction to −x-axis. In more detail, when aforce is applied in the −x-axis, the controller 290 can set to areference line A2 a second edge 253 or an extension line of the secondedge 253 of the display 250, which is perpendicular to the −x-axis andlocated in the +x-axis direction that is in opposite direction to−x-axis.

The controller 290 can stretch the entire display unit 250 by a stretchdistance d2 in a −x-axis direction based on the obtained reference lineA2. The stretch criterion is described as an edge of the display unit250 in an embodiment of FIG. 4, but is not limited hereto and may be asurface of the display unit 250.

Next, description is provided with reference to FIG. 5. In particular,FIG. 5 is a view illustrating an example that the stretchable displayunit is stretched when a force is applied in a +y-axis directionaccording to an embodiment. Referring to FIG. 5, the controller 290 candetect the force applied to the display unit 250 and check a directionof the detected force. When the direction of the detected force is apositive y-axis (+y-axis) direction, the controller 290 can obtain as astretch criterion an edge or surface of the display unit 250, which isperpendicular to +y-axis and located in an opposite direction to+y-axis.

In more detail, when a force is applied in the +y-axis, the controller290 can obtain as a reference line A3 a third edge 255 or an extensionline of the third edge 255 that is perpendicular to the +y-axis andlocated in a −y-axis that is an opposite direction to the +y-axisdirection. The controller 290 can stretch the entire display unit 250 bya stretch distance d3 in a +y-axis direction based on the obtainedreference line A3. The stretch criterion is described as the edge of thedisplay unit 250 in an embodiment of FIG. 5, but is not limited heretoand may be the surface of the display unit 250.

Next, description is provided with reference to FIG. 6. In particular,FIG. 6 is a view illustrating an example that the stretchable displayunit is stretched when a force is applied in a −y-axis directionaccording to an embodiment. Referring to FIG. 6, the controller 290 candetect a force applied to the display unit 250 and check a direction ofthe detected force. When the direction of the detected force is anegative y-axis (−y-axis) direction, the controller 290 can obtain as astretch criterion an edge or surface of the display unit 250 that isperpendicular and located in an opposite direction to −y-axis.

In more detail, when a force is applied in the −y-axis, the controller290 can set to a reference line A3 a fourth edge 257 or an extensionline of the fourth edge 257 of the display unit 250, which isperpendicular to and located in a +y-axis that is an opposite directionto the −y-axis direction. The controller 290 can stretch the entiredisplay unit 250 by a stretch distance d4 in a −y-axis direction basedon the set reference line A4. The stretch criterion is described as theedge of the display unit 250 in an embodiment of FIG. 6, but is notlimited hereto and may be the surface of the display unit 250.

Next, description is provided with reference to FIG. 7. In particular,FIG. 7 is a view illustrating an example that the stretchable displayunit is stretched when a force is simultaneously applied in +x-axis and+y-axis directions according to an embodiment. Referring to FIG. 7, thecontroller 290 can detect a force applied to the display unit 250 andcheck a direction of the detected force. When the detected force is inthe +x axis and +y-axis directions (i.e., an upper diagonal direction),the controller 290 can obtain as the stretch criterion edges or surfacesof the display unit 250, which are perpendicular to and located inopposite directions to the +x-axis and +y-axis.

In more detail, when the force is applied in +x-axis and +y-axisdirections, the controller 290 can set to the stretch criterion theextension line A1 of the first edge 251 and the extension line A3 of thethird edge 255 of the display unit 250 located on the −x-axis and−y-axis that are respectively opposite to the +x-axis and +y-axisdirections. The controller 290 can stretch the entire display unit 250by a stretch distance d5 in the +x-axis and by a stretch distance d6 inthe +y-axis based on the set stretch criterion. The stretch criterion isdescribed as an edge of the display unit 250 in an embodiment of FIG. 7,but is not limited hereto and may be a surface of the display unit 250.

Next, description is provided with reference to FIG. 8. In particular,FIG. 8 is a view illustrating an example that the stretchable displayunit is stretched when a force is simultaneously applied in +x-axis,−x-axis, +y-axis, and −y-axis directions according to an embodiment.Referring to FIG. 8, the controller 290 can detect a force applied tothe display unit 250 and check a direction of the detected force. Whenthe detected force is in the +x-axis, −x-axis, +y-axis, and −y-axisdirections (i.e., upper and lower diagonal directions), the controller290 can obtain the center point of the display unit 250 as the stretchcriterion. The controller 290 can stretch the display unit 250 based onthe center point of the display unit 250 by a stretch distance d7 in the+x-axis direction, a stretch distance d8 in the −x-axis direction, astretch distance d9 in the +y-axis direction, and a stretch distance d10in the −y-axis direction.

Next, description is provided with reference to FIG. 9. In particular,FIG. 9 is a view illustrating an example that the stretchable displayunit is stretched when a force is simultaneously applied in +x-axis and−x-axis directions according to an embodiment. Referring to FIG. 9, thecontroller 290 can detect a force applied to the display unit 250 andcheck a direction of the detected force. When the detected direction ofthe force is in +x-axis and −x-axis directions, the controller 290passes the center point of the display unit 250 and obtains as thestretch criterion a y-axis center line A5 perpendicular to the +x-axisand −x-axis directions. The controller 290 can stretch the entire areaof display unit 250 by a stretch distance d1 in the +x-axis and astretch distance d2 in the −x-axis based on the obtained stretchcriterion.

Next, description is provided with reference to FIG. 10. In particular,FIG. 10 is a view illustrating an example that the stretchable displayunit is stretched when a force is simultaneously applied in +y-axis and−y-axis directions according to an embodiment. Referring to FIG. 10, thecontroller 290 can detect a force applied to the display unit 250 andcheck a direction of the detected force. When the detected direction ofthe force is in +y-axis and −y-axis directions, the controller 290passes the center point of the display unit 250 and obtains as thestretch criterion a y-axis center line A5 perpendicular to the +y-axisand −y-axis directions. The controller 290 can stretch the entiredisplay unit 250 by the stretch distance d3 in the +y-axis and a stretchdistance d4 in the −y-axis based on the obtained stretch criterion.

Next, description is provided again with reference to FIG. 2. Inparticular, the controller 290 stretches the display unit 250 andcontrols the display unit 250 to display additional information on thestretched area (operation S109). In an embodiment, when a part of mediacontent is displayed on the display unit 250 before stretch, thecontroller 290 can additionally display the media content as much ascorresponding to the stretched area of the display unit 250.Descriptions about these will be provided with reference to FIGS. 11 and12.

FIGS. 11(a) and 11(b) are views illustrating various examplesillustrating information provided while the display unit is stretchedaccording to a force applied to the display unit, when an area to bestretched is not designated in the entire area formed by the displayunit. In particular, FIG. 11(a) illustrates the display unit 250 of thestretchable display device 200 before being stretched with media contentdisplayed on the display unit 250. The media content may be any one of avideo, image, and text, but this is just an example. The media contentis assumed to be an image 301 and explained in FIGS. 11(a) and 11(b).

When the force is applied in the +x-axis direction in FIG. 11(a), thecontroller 290 can stretch the display unit 250 in the +x-axis directionby a specific area 303 corresponding to the stretch distance d1 based onthe reference line A1. As the display unit 250 is stretched by thespecific area 303, the controller 290 can control the display unit 250so that a hidden area in an entire image 301 provided to the displayunit 250 is displayed on the stretched specific area 303. The user canthus stretch the display unit 250 using only a force applied to thedisplay unit 250 to easily view the image hidden by the display unit 250before being stretched.

Next, description is provided with reference to FIGS. 12(a) and 12(b).In particular, FIG. 12(a) illustrates the display unit 250 of thestretchable display device 200 before being stretched. Description isprovided by assuming that the text 305 is displayed on the display unit250.

When the force is applied in the +x-axis direction in FIG. 12(a), thecontroller 290 can stretch the display unit 250 in the +x-axis directionby a specific area 303 corresponding to the stretch distance d1 based onthe reference line A1. As the display unit 250 is stretched by thespecific area 303, the controller 290 can control the display unit 250so that a hidden part in an entire text 305 provided to the display unit250 is displayed on the stretched specific area 303.

The user thus does not undergo inconvenience in reading the text bystretching the display unit 250 only with an operation of applying theforce to the display unit 250 to view the hidden text on the displayunit 250.

Next, description is provided again with reference to FIG. 2. Thecontroller 290 obtains a force applied to the z-axis direction(operation S111) and zooms in or zooms out the media content provided onthe display unit 250 according to the obtained force of the z-axisdirection (operation S113).

Descriptions about operations S111 and S113 will be provided withreference to FIGS. 13 and 14. In particular, FIGS. 13 and 14 are viewsillustrating an embodiment in which media content provided on thedisplay unit is zoomed-in and zoomed-out when the direction of the forceapplied to the display unit is in the z-axis direction according to anembodiment.

FIGS. 13 and 14 use the embodiment described in relation to FIG. 12. Inother words, the display unit 250 displays the text 305 and is assumedto be in a state of being stretched in the +x-axis by d1. First,description is provided in relation to FIG. 13. Referring to FIG. 13,the controller 290 can obtain a force applied in the −z-axis to thedisplay unit 250 when the specific area 303 is stretched. The controller290 can zoom-in the text 305 displayed on the display unit 250 in astretched state according to the force applied in the −z-axis direction.

Next, description is provided in relation to FIG. 14. Referring to FIG.14, the controller 290 can obtain a force applied in the +z-axis to thedisplay unit 250 when the specific area 303 is stretched. The controller290 can zoom-out the text 305 displayed on the display unit 250 in astretched state according to the force applied in the +z-axis direction.

According to an embodiment, when a force for twisting the display unit250 when the display unit 250 is stretched, the controller 290 can fixthe display unit 250 in the stretched state. In embodiments of FIGS. 13and 14, the −z-axis and +z-axis directions may be applied in a switchedmanner.

According to another embodiment, when the specific pressure is appliedwhen the display unit 250 is stretched, the stretched state can bemaintained. In addition, when an applied force disappears when thedisplay unit 250 is stretched, the controller 290 can return the displayunit 250 to a state before the stretch. Descriptions about this will beprovided with reference to FIGS. 15 and 16.

In particular, FIGS. 15 and 16 are views illustrating examples of fixingor returning to an original state the display unit in the stretchedstate according to various embodiments. The display unit 250 is assumedto be when the display unit 250 is stretched by the stretch distance d1in the +x-direction in FIGS. 15 and 16.

First, a description is provided in relation to FIG. 15. Referring toFIG. 15, when a force is applied which allows the display unit 250 inthe stretched state to be twisted, the controller 290 can fix thedisplay unit 250 when the specific area 303 is stretched. The force fortwisting the display unit 250 may include the +z direction force appliedto one surface and −z-direction force applied to another surface of thedisplay unit 250 at the same time. Thus, the user can fix the displayunit 250 in the stretch state only with an operation for twisting thedisplay unit 250 when the stretchable display device 200 is gripped withboth hands.

Next, description is provided in relation to FIG. 16. Referring to FIG.16, when the force applied in the −x-axis direction disappears when thedisplay unit 250 is stretched, the controller 290 can return the displayunit 250 in the stretched state to the display unit 250 before beingstretched. For example, the user can stretch the display unit 250 by thespecific area 303 by griping one surface of the display unit 250 withthe left hand and applying the +x-axis direction force through the righthand. In this state, when the force applied in the +x-axis directiondisappears (i.e., relaxing the right hand), the display 250 returns tothe state before the stretch.

Next, description is provided again in relation to FIG. 2. Furthermore,when the area designation input is received in operation S101 (yes inS101), the controller 290 obtains the stretch criterion according to thereceived area designation input (operation S115). In an embodiment, thearea designation input may be a touch input received through the displayunit 250. The controller 290 can obtain the stretch criterion that is acriterion for stretching a partial area to be stretched in the entirearea of the display unit 250 based on a touch point corresponding to thetouch input. For example, the controller 290 can obtain as the stretchcriterion an x-axis direction line passing the touch point and a y-axisdirection line passing the touch point.

In another embodiment, the area designation input may be an input forselecting a specific content item among one or more content itemsdisplayed on the display unit 250. In another embodiment, the areadesignation input may be a touch pen input for designating an areathrough a touch pen on the display unit 250. In still anotherembodiment, the area designation input may be an input through which aforce bending the display unit 250 is applied. A description about anembodiment in which the stretch criterion is obtained according to thearea designation input will be described later.

The controller 290 checks a direction of the force applied to thedisplay unit (operation S117), and stretches a part of the entire areaof the display unit in the checked direction of the force based on theobtained stretch criterion (operation S119). The controller 290 canenlarge media content displayed on the partial area or control thedisplay unit 250 to display additional information (operation S121).

Hereinafter, operations S115 to S121 will be described in detail. Inparticular, FIGS. 17 to 28 are views illustrating embodiments that thedisplay unit is stretched base on an obtained stretch criterion when thearea designation input is a touch input according to variousembodiments.

First, referring to FIG. 17, the controller 290 can receive a touchinput for area designation at one point (e.g., the touch point 250-2) ona third corner 255 of the display unit 250. The controller 290 canobtain the stretch criterion based on the touch point 250-2corresponding to the received touch input. The controller 290 candisplay the y-axis direction line 501 in the y-axis directionperpendicular to the touch point 250-2 on the display unit 250. They-axis direction line 501 may be the stretch criterion fordistinguishing an area to be stretched in the entire area of the displayunit 250.

As shown, the entire area formed by the display unit 250 may include afirst area 601 disposed in the −x-axis direction and a second area 603disposed in +x-axis direction based on the y-axis direction line 501.When the force is applied in the −x-axis direction to the display unit250, the controller 290 can stretch only the first area 601 of theentire area of the display unit 250 by the specific area 605 having thestretch distance d2 in the −x-axis direction. In other words, thecontroller 290 can control the display unit 250 so that although theforce is applied to the display unit 250 in the −x-axis direction, thesecond area 603 is fixed without stretch.

When the force is applied to the display unit 250 in the +x-axisdirection, the controller 290 can stretch only the second area 603 ofthe entire area of the display unit 250 in the +x-axis direction by aspecific area. Furthermore, information not displayed on the first area601 that is a stretch target can be provided to the stretched specificarea 605 of the display unit 250. In addition, as the display unit 250is stretched, information displayed on the first area 601 can beenlarged and displayed. Descriptions about this will be provided withreference to FIGS. 18 and 19.

Description in relation to FIGS. 18 and 19 will be provided based on anembodiment of FIG. 17. First, FIG. 18 is a view illustrating anembodiment providing additional information to the stretched specificarea according to an embodiment. Referring to FIG. 18, a product list701 including a plurality of product images and detailed description 703about the products are respectively displayed in the first area 601 andthe second area 603 of the display unit 250. When the force is appliedto the display unit in −x-axis direction, the controller 290 can stretchthe first area 601 by the specific area 605 based on the y-axisdirection line 501. The controller 290 can control the display unit 250so that a product image 705 hidden by the screen size of the first area601 on the stretched specific area 605 is additionally displayed.

Next, description is provided in relation to FIG. 19. In particular,FIG. 19 is a view illustrating an embodiment in which information isenlarged and displayed according to the stretch of the display unit by aspecific area according to an embodiment. Referring to FIG. 19, theproduct list 701 including a plurality of product images and detaileddescription 703 about the products are respectively displayed in thefirst area 601 and the second area 603 of the display unit 250. When theforce is applied to the display unit in −x-axis direction, thecontroller 290 can stretch the first area 601 by the specific area 605based on the y-axis direction line 501. The controller 290 can controlthe display unit 250 so that the product list 701 displayed in the firstarea 601 is enlarged and displayed according to the stretch of thedisplay unit 250 by the specific area 605.

Next, description is provided in relation to FIG. 20. Referring to FIG.20, the controller 290 can receive a touch input for area designation inone point (e.g., the touch point 250-3) on a first corner 251 of thedisplay unit 250. The controller 290 can obtain the stretch criterionbased on the touch point 250-3 corresponding to the received touchinput. The controller 290 can display the x-axis direction line 503 inthe x-axis direction horizontal to the touch point 250-3 on the displayunit 250. The x-axis direction line 503 may be the stretch criterion fordistinguishing an area to be stretched in the entire area of the displayunit 250.

The entire area formed by the display unit 250 may include a third area607 disposed in the +y-axis direction and a fourth area 609 disposed in−y-axis direction based on the x-axis direction line 503. When the forceis applied in the +y-axis direction to the display unit 250, thecontroller 290 can stretch only the third area 607 of the entire area ofthe display unit 250 by a specific area 611 having the stretch distanced3 in the +y-axis direction.

In other words, the controller 290 can control the display unit 250 sothat although the force is applied to the display unit 250 in the+y-axis direction, the fourth area 609 is fixed without the stretch.When the force is applied to the display unit 250 in the −y-axisdirection, the controller 290 can stretch only the fourth area 609 ofthe entire area of the display unit 250 in the −y-axis direction by aspecific area.

Next, description is provided in relation to FIG. 21. Referring to FIG.21, the controller 290 can receive a touch input for area designation inone point (e.g., the touch point 250-4) on a fourth corner 257 of thedisplay unit 250. The controller 290 can obtain the stretch criterionbased on the touch point 250-4 corresponding to the received touchinput. The controller 290 can display the y-axis direction line 505 inthe y-axis direction perpendicular to the touch point 250-4 on thedisplay unit 250. The y-axis direction line 505 may be the stretchcriterion for distinguishing an area to be stretched in the entire areaof the display unit 250.

The entire area formed by the display unit 250 may include a fifth area613 disposed in the +x-axis direction and a sixth area 615 disposed in−x-axis direction based on the y-axis direction line 505.

When the force is applied in the +x-axis direction to the display unit250, the controller 290 can stretch only the fifth area 613 of theentire area of the display unit 250 by a specific area 617 having thestretch distance d3 in the +x-axis direction. In other words, thecontroller 290 can control the display unit 250 so that although theforce is applied to the display unit 250 in the +x-axis direction, thesecond sixth area 615 is fixed without the stretch. When the force isapplied to the display unit 250 in the −x-axis direction, the controller290 can stretch only the sixth area 615 in the entire area of thedisplay unit 250 in the −x-axis direction by a specific area.

Next, description is provided in relation to FIG. 22. Referring to FIG.22, the controller 290 can receive a touch input for area designation inone point (e.g., the touch point 250-5) on a second corner 253 of thedisplay unit 255. The controller 290 can obtain the stretch criterionbased on the touch point 250-5 corresponding to the received touchinput. The controller 290 can display the x-axis direction line 507 inthe x-axis direction horizontal to the touch point 250-5 on the displayunit 250. The x-axis direction line 507 may be the stretch criterion fordistinguishing an area to be stretched in the entire area of the displayunit 250.

The entire area formed by the display unit 250 may include a seventharea 621 disposed in the −y-axis direction and an eighth area 623disposed in +y-axis direction based on the x-axis direction line 507.

When the force is applied in the −y-axis direction to the display unit250, the controller 290 can stretch only the seventh area 621 in theentire area of the display unit 250 by a specific area 625 having thestretch distance d4 in the −y-axis direction. In other words, thecontroller 290 can control the display unit 250 so that although theforce is applied to the display unit 250 in the −y-axis direction, theeighth area 623 is fixed without the stretch. When the force is appliedto the display unit 250 in the +y-axis direction, the controller 290 canstretch only the eighth area 623 of the entire area of the display unit250 in the +y-axis direction by a specific area.

Next, description is provided in relation to FIG. 23. Referring to FIG.23, the controller 290 can receive a touch input for area designation inone point (e.g., a touch point 250-6) on the display unit 250. Thecontroller 290 can obtain the stretch criterion based on the touch point250-6 corresponding to the received touch input. The controller 290 candisplay the x-axis and y-axis direction lines 511 and 513 passing thetouch point 250-6 on the display unit 250.

The x-axis direction line 511 may be the stretch criterion fordistinguishing an area to be stretched in the entire area of the displayunit 250. In addition, the x-axis and y-axis direction lines 511 and 513may be a criterion for enlarging media content displayed in a partialarea of the entire area of the display unit 250 and additionallyproviding hidden information not display in the part area.

The entire area formed by the display unit 250 may include a designationarea 631 and a non-designation area 633 based on the x-axis and y-axisdirection lines 511 and 513. The designation area 631 may be an area forenlarging media content displayed in the designation area 631 oradditionally providing hidden information among information displayed inthe designation area 631 according to the stretch of the display unit250. The designation area 631 is indicated with a diagonal line and thenon-designation area 633 is indicated without the diagonal line.

When the force is applied to the display unit 250 in the −y-axisdirection, the controller 290 can stretch only an area positioned in the−y-axis direction based on the x-axis direction lines 511 in the entirearea of the display unit 250. Accordingly the display unit 250 may bestretched in the −y-axis direction by a specific area 635 having astretch distance d4. The controller 290 can enlarge media contentdisplayed in the designation area 631 or display information hidden andnot displayed on the designation area 631 as a partial area of thedisplay unit 250 is stretched. Description about this will be describedwith reference to FIG. 24.

FIG. 24 is assumed to be based on the embodiment of FIG. 23. Referringto FIG. 24, the text 305 is displayed on the display unit 250. When theforce is applied to the display unit 250 in the −y-axis direction, thecontroller 290 can stretch only an area positioned in the −y-axisdirection based on the x-axis direction lines 511 in the entire area ofthe display unit 250. The controller 290 can control the display unit250 to enlarge and display only the text displayed on the designationarea 631 as the stretch of a partial area of the display unit 250. Inother words, the controller 290 can control the display unit to fix thesize of the text displayed in the non-designation area 633 and enlargeto display only the text displayed in the designation area 631.

Next, description is provided in relation to FIG. 25. Referring to FIG.25, the controller 290 can receive a touch input for area designation inone point (e.g., a touch point 250-7) on the display unit 250. Thecontroller 290 can obtain the stretch criterion based on the touch point250-7 corresponding to the received touch input. The controller 290 candisplay the x-axis and y-axis direction lines 521 and 523 passing thetouch point 250-7 on the display unit 250. The x-axis direction line 521may be the stretch criterion for distinguishing an area to be stretchedin the entire area of the display unit 250. In addition, the x-axis andy-axis direction lines 521 and 523 may be a criterion for enlargingmedia content displayed in a partial area of the entire area of thedisplay unit 250 and additionally providing hidden and not displayedinformation in the part area.

The entire area formed by the display unit 250 may include a designationarea 641 and a non-designation area 643 based on the x-axis and y-axisdirection lines 521 and 523. The designation area 641 may be an area forenlarging media content displayed in the designation area 641 oradditionally providing the hidden information among informationdisplayed in the designation area 641 according to the stretch of thedisplay unit 250. The designation area 641 is indicated with a diagonalline and the non-designation area 643 is indicated without the diagonalline.

When the force is applied to the display unit 250 in the +y-axisdirection, the controller 290 can stretch only an area positioned in the+y-axis direction based on the x-axis direction lines 521 in the entirearea of the display unit 250. Accordingly the display unit 250 may bestretched in the +y-axis direction by a specific area 645 having thestretch distance d3. The controller 290 can enlarge media contentdisplayed in the designation area 641 or display information hidden andnot displayed in the designation area 641 as a partial area of thedisplay unit 250 is stretched.

Next, description is provided in relation to FIG. 26. Referring to FIG.26, the controller 290 can receive a touch input for area designation inone point (e.g., a touch point 250-8) on the display unit 250. Thecontroller 290 can obtain the stretch criterion based on the touch point250-8 corresponding to the received touch input. The controller 290 candisplay the x-axis and y-axis direction lines 531 and 533 passing thetouch point 250-8 on the display unit 250. The y-axis direction line 533may be the stretch criterion for distinguishing an area to be stretchedin the entire area of the display unit 250. In addition, the x-axis andy-axis direction lines 531 and 533 may be a criterion for enlargingmedia content displayed in a partial area in the entire area of thedisplay unit 250 and additionally providing hidden and not displayedinformation in the partial area.

The entire area formed by the display unit 250 may include thedesignation area 651 and the non-designation area 653 based on thex-axis and y-axis direction lines 531 and 533. The designation area 651may be an area for enlarging media content displayed in the designationarea 651 or additionally providing the hidden information amonginformation displayed in the designation area 651 according to thestretch of the display unit 250. The designation area 651 is indicatedwith a diagonal line and the non-designation area 653 is indicatedwithout the diagonal line.

When the force is applied to the display unit 250 in the −x-axisdirection, the controller 290 can stretch only an area positioned in the−x-axis direction based on the y-axis direction line 533 in the entirearea of the display unit 250. Accordingly the display unit 250 may bestretched in the −x-axis direction by a specific area 655 having thestretch distance d2. The controller 290 can enlarge media contentdisplayed in the designation area 651 or display information hidden andnot displayed in the designation area 651 as a partial area of thedisplay unit 250 is stretched.

Next, description is provided in relation to FIG. 27. Referring to FIG.27, the controller 290 can receive a touch input for area designation inone point (e.g., a touch point 250-9) on the display unit 250. Thecontroller 290 can obtain the stretch criterion based on the touch point250-9 corresponding to the received touch input. The controller 290 candisplay the x-axis and y-axis direction lines 541 and 543 passing thetouch point 250-9 on the display unit 250. The y-axis direction line 543may be the stretch criterion for distinguishing an area to be stretchedin the entire area of the display unit 250. In addition, the x-axis andy-axis direction lines 541 and 543 may be a criterion for enlargingmedia content displayed in a partial area of the entire area of thedisplay unit 250 and additionally providing hidden and not displayedinformation in the partial area.

The entire area formed by the display unit 250 may include thedesignation area 661 and the non-designation area 663 based on thex-axis and y-axis direction lines 541 and 543. The designation area 661may be an area for enlarging media content displayed in the designationarea 661 or additionally providing the hidden information amonginformation displayed in the designation area 661 according to thestretch of the display unit 250. The designation area 661 is indicatedwith a diagonal line and the non-designation area 663 is indicatedwithout the diagonal line.

When the force is applied to the display unit 250 in the +x-axisdirection, the controller 290 can stretch only an area positioned in the+x-axis direction based on the y-axis direction line 543 in the entirearea of the display unit 250. Accordingly the display unit 250 may bestretched in the +x-axis direction by a specific area 665 having thestretch distance d1. The controller 290 can enlarge media contentdisplayed in the designation area 661 or display information hidden andnot displayed in the designation area 661 according to the stretch of apartial area of the display unit 250.

Next, description is provided in relation to FIG. 28. Referring to FIG.28, the controller 290 can receive a touch input for area designation inone point (e.g., a touch point 250-7) on the display unit 250. Thecontroller 290 can obtain the stretch criterion based on the touch point250-7 corresponding to the received touch input. The controller 290 candisplay the x-axis and y-axis direction lines 521 and 523 passing thetouch point 250-7 on the display unit 250. The x-axis and y-axisdirection lines 521 and 523 may be the stretch criterion fordistinguishing an area to be stretched in the entire area of the displayunit 250. In addition, the x-axis and y-axis direction lines 521 and 523may be a criterion for enlarging media content displayed in a partialarea of the entire area of the display unit 250 and additionallyproviding hidden and not displayed information in the partial area.

The entire area formed by the display unit 250 may include thedesignation area 671 and the non-designation area 673 based on thex-axis and y-axis direction lines 521 and 523. The designation area 671may be an area for enlarging media content displayed in the designationarea 671 or additionally providing the hidden information amonginformation displayed in the designation area 671 according to thestretch of the display unit 250. The designation area 671 is indicatedwith a diagonal line and the non-designation area 673 is indicatedwithout the diagonal line.

When the force is applied to the display unit 250 in the +x-axis and+y-axis directions, the controller 290 can stretch only an areapositioned in the +y-axis direction based on the x-axis direction line521 and in the +x-axis direction based on the y-axis direction line 523in the entire area of the display unit 250. Accordingly the display unit250 may be stretched in the +x-axis direction by the specific area 675having the stretch distance d3 in the +y-axis direction. The controller290 can enlarge media content displayed in the designation area 671 ordisplay information hidden and not displayed in the designation area 671according to the stretch of a partial area of the display unit 250.

According to another embodiment, a specific content item may be selectedamong one or more content items displayed in the display unit 250 andthe selected content item may be enlarged when the display unit 250 isstretched. Descriptions about this will be provided with reference toFIGS. 29 and 30.

FIGS. 29 and 30 are views illustrating embodiments that the display unitis stretched base on an obtained stretch criterion when the areadesignation input is an input selecting a content item according to anembodiment. Referring to FIG. 29, the display unit 250 may display aplurality of images. When a touch input for selecting a specific image711 among the plurality of images is received, the controller 290 canobtain as the stretch criterion the x-axis direction line 551 passing atouch point corresponding to the received touch input.

The x-axis direction line 551 may be displayed on the display unit 250according to the reception of the touch input. When the force is appliedin the −y-axis direction, the controller 290 can stretch only an areapositioned in the −y-axis direction based on the x-axis direction line511 in the entire area of the display unit 250. Accordingly, the displayunit 250 may be stretched by a specific area 710. The controller 290 cancontrol the display unit 250 to enlarge to display the selected specificimage 711 while stretching only an area positioned in the −y-axisdirection based on the x-axis direction line 551 in the entire area ofthe display unit 250. The specific image 711 may be enlarged to bedisplayed only in the −y-axis direction of the x-axis direction line551.

According to another embodiment, when a touch input for selecting thespecific image 711 is received among the plurality of images, thecontroller 290 can obtain the first corner 251 position in the +y-axisdirection of a touch point corresponding to the received touch input asthe stretch criterion.

Next, description is provided in relation to FIG. 30. Referring to FIG.30, the display unit 250 may display a plurality of images. When a touchinput for selecting a specific image 711 is received among the pluralityof images, the controller 290 can obtain the x-axis direction line 551passing a touch point corresponding to the received touch input as thestretch criterion. The x-axis direction line 551 may be displayed on thedisplay unit 250 according to the reception of the touch input.

When the force is applied in the −y-axis direction, the controller 290can stretch only an area positioned in the −y-axis direction based onthe x-axis direction line 511 in the entire area of the display unit250. Accordingly, the display unit 250 may be stretched by a specificarea 710. The controller 290 can control the display unit 250 to enlargeto display the selected specific image 711 while stretching only an areapositioned in the −y-axis direction based on the x-axis direction line551 in the entire area of the display unit 250.

According to another embodiment, when a touch input for selecting thespecific image 711 is received among the plurality of images, thecontroller 290 can obtain the first corner 251 positioned in the +y-axisdirection of a touch point corresponding to the received touch input.According to another embodiment, the stretch criterion may receive toobtain the area designation input through a touch pen. The display unit250 may be stretched according to the stretch criterion obtained throughthe touch pen and a direction of the applied force.

Descriptions about this will be provided with reference to FIGS. 31 to33. In particular, FIGS. 31 to 33 are views illustrating an embodimentin which the stretch criterion is obtained through the touch pen and apartial area of the display unit is stretched according to the obtainedstretch criterion and the direction of the applied force.

Referring to FIG. 31, the controller 290 can receive an input drawingthe y-axis direction line A7 on the display unit 250 through the touchpen 400. The controller 290 can obtain the y-axis direction line A7 asthe stretch criterion. The entire area of the display unit 250 may bedivided into a ninth area 252 and a tenth area 254 along the y-axisdirection line A7. As illustrated in FIG. 32, when a force is applied inthe +x-axis direction, the controller 250 may stretch only the tentharea 254 of the entire area of the display unit 250. The tenth area 254may be stretched by the specific area 307 having the stretch distanced1.

As illustrated in FIG. 33, when a force is applied in the −x-axisdirection, the controller 290 can stretch only the ninth area 252 of theentire area of the display unit 250. The ninth area 252 may be stretchedby the specific area 309 having the stretch distance d2. According toanother embodiment, the stretch criterion may be obtained according toan input for bending the stretchable display device 200. The displayunit 250 may be stretched according to the stretch criterion obtainedthrough the bending input and the direction of the applied force.Descriptions about this will be provided with reference to FIGS. 34 and35.

FIGS. 34 and 35 are views illustrating an embodiment in which thestretch criterion is obtained through an input for bending thestretchable display device 200 and a partial area of the display unit isstretched according to the obtained stretch criterion and the directionof the applied force.

Referring to FIG. 34, the controller 290 can control the display unit250 to display a y-axis direction line A8 corresponding to a foldedportion on the display unit 250 according to a force for folding thedisplay unit 250. The controller 290 can obtain the y-axis directionline A8 as the stretch criterion. The entire area of the display unit250 may be divided unto an eleventh area 256 and a twelfth area 258along the y-axis direction line A8.

As illustrated in FIG. 35, when a force is applied in the +x-axisdirection, the controller 290 can stretch only the twelfth area 258 ofthe entire area of the display unit 250. The twelfth area 258 may bestretched by a specific area 333. The product image 339 displayed on thetwelfth area 258 before the stretch may be enlarged according to a ratioof the stretched specific area 333 and displayed as the twelfth area 258of the display unit 250 is stretched by the specific area 333

The user can more accurately view desired information only with anoperation of folding the stretchable display device 200 and an operationapplying a force to the stretchable display device 200 in a specificdirection.

Next, a configuration of a mobile terminal included in the stretchabledisplay device 200 is described with reference to FIG. 36. The mobileterminal described herein may include a mobile phone, smart phone,laptop computer, terminal for digital broadcast, personal digitalassistants (PDA), portable multimedia player (PMP), navigator, slate PC,tablet PC, ultrabook, or wearable device, for example, a smart watch,smart glass, and head mounted display (HMD).

However, those skilled in the art may easily understand that theconfiguration according to the embodiment described herein may be alsoapplied to a stationary terminal such as a digital TV, desk computer, ordigital signage when a case of being applicable only to the mobileterminal is excluded.

FIG. 36 is a block diagram illustrating explaining a mobile terminal inrelation to an embodiment. In this instance, the stretchable display 200may include elements of the mobile terminal 100. In particular, thesensing unit 210 of the stretchable display device 200 may perform afunction of the sensing unit 140 of the mobile terminal 100, the displayunit 250 may perform a function of the display unit 152 of the mobileterminal 250, and the storage unit 270 may perform a function of thememory 170 of the mobile terminal 270.

The mobile terminal 100 may include a wireless communication unit 110,an input unit 120, a sensing unit 140, an output unit 150, an interfaceunit 160, a memory unit 170, a controller 180, and a power supply unit190. Since the elements illustrated in FIG. 1 are not essential forrealizing a mobile terminal, a mobile terminal to be described hereinmay include more or fewer elements than the above-described.

In more detail, the wireless communication unit 110 among the elementsmay include one or more modules enabling wireless communication betweenthe mobile terminal 100 and another mobile terminal 100, or between themobile terminal 100 and an external server. In addition, the wirelesscommunication 110 may include one or more modules connecting the mobileterminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of abroadcast reception module 111, a mobile communication module 112, awireless internet module 113, a short range communication module 114,and a location information module 115.

The input unit 130 may include a camera 121 or an image input unit foran image signal input, a microphone 122 or an audio input unit for anaudio signal input, a user input unit 123 (e.g., a touch key, amechanical key, etc.) for receiving information from a user. Voice dataor image data collected by the input unit 120 may be analyzed andprocessed with user's control commands.

The sensing unit 140 may include at least one sensor for sensing atleast one of surrounding environment information around the mobileterminal and user information. For example, the sensing unit 140 mayinclude at least one selected from a proximity sensor 141, anillumination sensor 142, a touch sensor, an acceleration sensor, amagnetic sensor, a G-sensor, a gyroscope sensor, a motion sensor, an RGBsensor, an infrared (IR) sensor, a finger scan sensor, an ultrasonicsensor, an optical sensor (e.g., the camera 121), a microphone 122, abattery gauge, an environmental sensor (e.g., a barometer, a hygrometer,a thermometer, a radiation sensor, a thermal sensor, a gas detectionsensor, etc.), a chemical sensor (e.g., an e-nose, a healthcare sensor,a biometric sensor, etc.). Furthermore, the mobile terminal disclosedherein may combine and use information sensed by at least two sensorsamong those sensors.

The output unit 150 is for generating an output related to sense ofsight, sense of hearing, or sense of touch, and may include at least oneselected from a display unit 151, an audio output unit 152, a hapticmodule 153, and a light output unit 154. The display unit 151 may form amutually layered structure with or be formed into one with a touchsensor, and realize a touch screen. Such a touch screen may not onlyfunction as the user input unit 123 providing an input interface betweenthe mobile terminal 100 and the user, but also provide an outputinterface between the mobile terminal 100 and the user.

The interface unit 160 plays a role of a passage with various kinds ofexternal devices connected to the mobile terminal 100. This interfaceunit 160 may include at least one selected from a wired/wireless headsetport, an external charger port, a wired/wireless data port, a memorycard port, a port connecting a device having an identification moduleprepared therein, an audio input/output (I/O) port, a video input/output(I/O) port, and an earphone port. In the mobile terminal 100, a propercontrol may be performed on a connected external device incorrespondence to connection between the external device and theinterface unit 160.

In addition, the memory 170 stores data for supporting various functionsof the mobile terminal 100. The memory 170 may store a plurality ofapplication programs or applications driven in the mobile terminal 100,data for operations of the mobile terminal 100, and instructions. Atleast a part of these application programs may exist in the mobileterminal 100 at the time of release for basic functions (e.g., a calloriginating or receiving function, a message transmitting and receivingfunction). Moreover, the application programs are stored in the memory170 and installed in the mobile terminal 100, and then may be driven toperform operations (or functions) of the mobile terminal by thecontroller 180.

The controller 180 typically controls overall operations of the mobileterminal 100 besides operations related to the application programs. Thecontroller 180 can provide the user with, or process proper informationor functions by processing a signal, data, or information input oroutput through the above-described elements, or driving the applicationprograms stored in the memory 170.

In addition, the controller 180 may control at least a part of theelements illustrated in FIG. 36 so as to drive the application programsstored in the memory 170. Furthermore, the controller 180 may combine atleast two elements among the elements included in the mobile terminal100 and operate the combined.

The power supply unit 190 receives internal or external power under acontrol of the controller 180 and supplies the power to each elementincluded in the mobile terminal 100. The power supply unit 190 includesa battery and the battery may be an embedded type battery or areplaceable battery.

At least a part of the elements may operate in cooperation with eachother for realizing an operation, control, or control method of themobile terminal according to various embodiments. In addition, theoperation, control, or control method of the mobile terminal may berealized in the mobile terminal by driving at least one applicationprogram stored in the memory 170.

Hereinafter, the above-described elements are described in detail withreference to FIG. 36 before describing various embodiments realizedthrough the mobile terminal 100.

Firstly, in the wireless communication unit 110, the broadcast receptionmodule 111 receives a broadcast signal and/or broadcast relatedinformation from an external broadcast management server through abroadcast channel. The broadcast channel may include a satellite channelor a terrestrial channel. Two or more broadcast reception modules may beprovided to the mobile terminal 100 for simultaneous broadcast receptionor broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may transmit and receive wirelesssignals to and from at least one selected from a base station, anexternal terminal, and a server on a mobile communication networkconstructed according to technical standards or communication schemesfor the mobile communication (e.g., Global System for Mobilecommunication (GSM), Code Division Multi Access (CDMA), Code DivisionMulti Access 2000 (CDMA 2000), Enhanced Voice-Data Optimized or EnhancedVoice-Data Only (EV-DO), Wideband CDMA (WCDMA), High Speed DownlinkPacket Access (HSDPA), High Speed Uplink Packet Access (HISUPA), LongTerm Evolution (LTE), and Long Term Evolution-Advanced (LTE-A) etc.).The wireless signal may include a voice call signal, a video callsignal, or various types of data according to transmission and receptionof a text/multimedia message.

The wireless internet module 113 refers to a module for a wirelessinternet connection, and may be embedded in or prepared outside themobile terminal 100. The wireless internet module 113 is configured totransmit and receive a wireless signal over a communication networkconforming for wireless internet technologies.

The wireless internet technologies include, for example, Wireless LAN(WLAN), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, Digital Living NetworkAlliance (DLNA), Wireless Broadband (WiBro), World Interoperability forMicrowave Access (WiMAX), High Speed Downlink Packet Access (HSDPA),High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), andLTE-Advanced (LTE-A), and the wireless internet module 113 transmits andreceives data according to at least one wireless internet technologywithin the range of including internet technology not described in theabove.

From a viewpoint that an access to the wireless internet through WiBro,HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, or LTE-A is conducted through amobile communication network, the wireless internet module 113conducting the access to the wireless internet through the mobilecommunication network may be understood as a kind of the mobilecommunication module 112.

The short range communication module 114 is for short rangecommunication and may support the short range communication by using atleast one selected from Bluetooth™, Radio Frequency Identification(RFID), Infrared Data Association (IrDA), Ultra Wideband UWB), ZigBee,Near Field Communication (NFC), Wi-Fi, Wi-Fi Direct, and WirelessUniversal Serial Bus (Wireless USB) technologies. This short rangecommunication module 114 may support, through a wireless area network,wireless communication between the mobile communication terminal 100 anda wireless communication system, between the mobile terminal 100 andanother mobile terminal 100, or between the mobile terminal 100 and anetwork on which the other mobile terminal 100 or an external server islocated. The wireless area network may be a wireless personal areanetwork.

Here, the other mobile terminal 100 may be a wearable device (e.g., asmart watch, a smart glass, or an HMD) through which data is mutuallyexchangeable (or interoperable) with the mobile terminal 100 accordingto an embodiment. The short range communication module 114 may detect(or recognize) a wearable device capable of communicating with themobile terminal 100. Furthermore, when the detected wearable device isauthenticated to communicate with the mobile terminal 100, thecontroller 180 may transmit at least a part of data processed in themobile terminal 100 to the wearable device through the short rangecommunication module 114. Therefore, a user of the wearable device mayuse the data processed by the mobile terminal 100 through the wearabledevice. For example, when a call is received by the mobile terminal 100,the user may perform a phone call through the wearable device, or when amessage is received by the mobile terminal 100, the user may check thereceived message through the wearable device.

The location information module 115 is for obtaining a location (or acurrent location) of the mobile terminal. As a representative examplethereof, there is a global positioning system (GPS) module or a Wi-Fimodule. For example, when adopting the GPS module, the mobile terminalmay obtain a location of the mobile terminal by using a signaltransmitted from a GPS satellite. In another example, when adopting theWi-Fi module, the mobile terminal may obtain the location of the mobileterminal based on information on a wireless access point (AP)transmitting or receiving a wireless signal with the Wi-Fi module. Ifnecessary, the location information module 115 may additionally oralternatively perform any one function among other modules in thewireless communication unit 110 in order to obtain data about thelocation of the mobile terminal. The location information module 115 isa module used for obtaining the location (or current location) of themobile terminal, and is not limited to a module directly calculating orobtaining the location of the mobile terminal.

Next, the input unit 120 is for receiving image information (or an imagesignal), audio information (or an audio signal), data, or informationinput from the user. The mobile terminal 100 may include one or aplurality of cameras 121 for an input of image information. The camera121 processes an image frame such as a still image or video obtained byan image sensor in a video call mode or an image capturing mode. Theprocessed image frame may be displayed on the display unit 151 or storedin the memory 170. Furthermore, the plurality of cameras 121 prepared inthe mobile terminal 100 may be arranged to form a matrix structure, and,through the cameras 121 forming this matrix structure, a plurality ofpieces of information on images having different angles or differentfocuses may be input to the mobile terminal 100. In addition, theplurality of cameras 121 may be arranged in a stereo structure to obtainleft and right images for realizing a stereoscopic image.

The microphone 122 may process an external sound signal as electricalvoice data. The processed voice data may be variously used according toa function (or an application program) being performed in the mobileterminal 100. Furthermore, various noise removal algorithms may beimplemented for removing noise generated in a process for receiving theexternal sound signal.

The user input unit 123 is for receiving information from the user. Wheninformation is input through the user input unit 123, the controller 180may control an operation of the mobile terminal 100 in correspondence tothe input information. This user input unit 123 may include a mechanicalinput unit (or mechanical key, for example, buttons positioned on thefront and rear surfaces or on the side surfaces, a dome switch, a jogwheel, or a jog switch, etc.) and a touch type input unit. As anexample, the touch type input unit may be configured with a virtual keydisplayed on a touch screen through a software processing, a soft key,or a visual key, or a touch key disposed on a portion other than thetouch screen. In addition, the virtual key or the visual key is possiblydisplayed on the touch screen in various types and, for example, may beconfigured with graphics, texts, icons, videos, or a combinationthereof.

Furthermore, the sensing unit 140 may sense at least one ofenvironmental information surrounding the mobile terminal 100 and userinformation, and generate a sensing signal corresponding to the sensedinformation. The controller 180 may control driving or operations of themobile terminal 100, or perform data processing, a function, or anoperation related to an application program installed in the mobileterminal 100, based on the sensing signal. Hereinafter, representativesensors among various sensors that may be included in the sensing unit140 are described in detail.

Firstly, the proximity sensor 141 refers to a sensor detecting presenceof an object accessing or around a predetermined detecting surface byusing an electromagnetic force or an infrared ray without a mechanicalcontact. This proximity sensor 141 may be disposed in an internal areaof the mobile terminal surrounded by the above-described touch screen oraround the touch screen.

As an example of the proximity sensor 141, there is a transmissiveoptoelectronic sensor, a diffuse optoelectronic sensor, a high frequencyoscillating proximity sensor, a capacitive proximity sensor, aninductive proximity sensor, or an infrared proximity sensor. When thetouch screen is capacitive type, the proximity sensor 141 may beconfigured to detect an access of an object having conductivity by achange of an electric field according to the access of the object. Inthis instance, the touch screen (or a touch sensor) itself may beclassified into a proximity sensor.

Moreover, for convenience of explanation, a behavior that an object isin proximity to the touch screen without contacting the touch screen andis allowed to be recognized as if the object is on the touch screen isreferred to as a “proximity touch”. A behavior that an object actuallycontacts the touch screen is referred to as a “contact touch”. Aposition at which an object is subject to a proximity touch over thetouch screen means a position at which the object vertically correspondsto the touch screen when the object is subject to the proximity touch.The proximity sensor 141 may detect a proximity touch and a proximitytouch pattern (e.g., a proximity touch distance, a proximity touchdirection, a proximity touch speed, a proximity touch time, a proximitytouch position, a proximity touch shift state, etc.). Furthermore, thecontroller 180 may process data (or information) corresponding to aproximity touch action and the proximity touch pattern detected throughthe proximity sensor 141 and, in addition, may output visual informationcorresponding to the processed data on the touch screen. In addition,the controller 180 may control the mobile terminal 100 so that differentoperations or different data (or information) are processed according towhether a touch for an identical point on the touch screen is aproximity touch or a contact touch.

The touch sensor senses a touch (or a touch input) applied to the touchscreen (or the display unit 151) by using at least one of various touchschemes including a resistive-film scheme, a capacitive scheme, aninfrared ray scheme, an ultrasonic scheme, and a magnetic field scheme.

As an example, the touch sensor may be configured to convert a change inpressure applied to a specific part or a change in capacitance generatedat a specific part of the touch screen into an electrical input signal.The touch sensor may be configured to detect a position or an areathereon which is touched by a touch object touching the touch screen, orpressure or capacitance at the time of the touch. Here, the touch objectmay be an object applying a touch on the touch sensor, for example, afinger, a touch pen, a stylus pen, or a pointer.

In this way, when there is a touch input on the touch sensor, a signal(signals) corresponding thereto is (are) transmitted to a touchcontroller. The touch controller processes the signal(s) and transmitscorresponding data to the controller 180. Accordingly, the controller180 may know which area of the display unit 151 is touched. Here, thetouch controller may be a separate element other than the controller180, or be the controller unit itself.

Furthermore, the controller 180 may perform different controls or anidentical control according to a kind of the touch object, which touchesthe touch screen (or a touch key prepared other than the touch screen).Whether to perform different controls or an identical control accordingto a kind of the touch object may be determined according to a currentoperation state of the mobile terminal 100 or an application programbeing executed.

The above-described touch sensor and proximity sensor may senseindependently or in a combined manner various types of touches on thetouch screen, wherein the touches include a short (or a tap) touch, along touch, a multi-touch, a drag touch, a flick touch, a pinch-intouch, a pinch-out, a swipe touch, and a hovering touch.

The ultrasonic sensor may recognize position information on a touchobject by using an ultrasonic wave. The controller 180 can calculate aposition of a wave generating source through information sensed by anoptical sensor and a plurality of ultrasonic sensors. The position ofthe wave generating source may be calculated by using a property that alight is very faster than the ultrasonic wave, in other words, a timethat a light arrives at an optical sensor is very shorter than a timethat an ultrasound wave arrives at an ultrasonic sensor. In more detail,the position of the wave generating source may be calculated by using atime difference from a time when an ultrasonic wave arrives with a lightconsidered as a reference signal.

Furthermore, from a view of a configuration of the input unit 120, thecamera 121 includes at least one selected from a camera sensor (e.g., aCCD, or a CMOS sensor), a photo sensor (or an image sensor), and a lasersensor. The camera 121 and the laser sensor may be combined together andsense a touch of the sensing target for a 3-dimensional stereoscopicimage. The photo sensor may be stacked on a display element, and thisphoto sensor scans a movement of the sensing target close to the touchscreen. In more detail, the photo sensor includes photo diodes andtransistors in rows/columns and scans a target mounted on the photosensor by using an electrical signal changed according to an amount of alight applied to the photo diodes. In other words, the photo sensorperforms coordinate calculation on the sensing target according to achange amount of the light and, through this, position information onthe sensing target may be obtained.

The display unit 151 displays (outputs) information processed by themobile terminal 100. For example, the display unit 151 may displayexecution screen information on the application program driven in themobile terminal 100 or user interface (UI) information or graphic userinterface (GUI) information according to the execution screeninformation. In addition, the display unit 151 may be configured as astereoscopic display unit displaying a stereoscopic image. A3-dimensional display scheme such as a stereoscopic scheme (glassestype), an autostereoscopic scheme (glassless type), or a projectionscheme (a holographic scheme) may be applied to the stereoscopic displayunit.

The sound output unit 152 may output audio data received from thewireless communication unit 110 or stored in the memory 170 in a callsignal reception mode, a call mode or a recording mode, a speechrecognition mode, or in a broadcast reception mode. The sound outputunit 152 may output a sound signal related to a function (e.g., a callsignal reception sound, or a message reception sound, etc.) performed inthe mobile terminal 100. This sound output unit 152 may include areceiver, a speaker, or a buzzer, etc.

The haptic module 153 may generate various tactile effects that the usermay feel. A representative example of the tactile effect that isgenerated by the haptic module 153 may be vibration. Strength and apattern of the vibration generated by the haptic module 153 may becontrolled by user selection or setting by the controller. For example,the haptic module 153 may output different vibrations sequentially or bysynthesizing them.

Besides the vibration, the haptic module 153 may generate varioustactile effects including an effect by a stimulus such as a pin arraymoving vertically to a contact skin surface, a air discharge force orair absorptive power through an outlet or an inlet, brush against a skinsurface, contact to an electrode, or static electricity, and an effectby reproducing a cold and warmth sense by using a device that heatabsorption or heating is enabled.

The haptic module 153 may be implemented to transfer the tactile effectthrough a direct contact, and may also be implemented for the user tofeel the tactile effect through a muscle sense of a finger or an arm.The haptic module 153 may be prepared two or more in number according toa configuration aspect of the mobile terminal 100.

The optical output unit 154 may output a signal for notifying an eventoccurrence by using a light from an optical source of the mobileterminal 100. The event occurred in the mobile terminal 100 may beexemplified with message reception, call signal reception, missed calls,alarm, schedule notification, email reception, or information receptionthrough an application. The signal output by the optical output unit 154is implemented according to that the mobile terminal emits amonochromatic light or a multi-chromatic light towards the front or rearsurface. The signal output may be completed when the mobile terminaldetects that the user checks the event.

The interface unit 160 may play a role of a passage with all externaldevices connected to the mobile terminal 100. The interface unit 160 mayreceive data from the external device, receive power and transfer thepower to each element inside the mobile terminal 100, or allow internaldata of the mobile terminal 100 to be transmitted to the externaldevice. For example, the interface 160 may include a wired/wirelessheadset port, an external charger port, a wired/wireless data port, amemory card port, a port connecting a device that an identificationmodule is prepared, an audio input/output (I/O) port, a videoinput/output (I/O) port, or an earphone port, etc.

Furthermore, the identification module is a chip storing various piecesof information for authenticating user's authority for the mobileterminal 100 and may include a user identify module (UIM), a subscriberidentity module (SIM) or a universal subscriber identity module (USIM).A device including the identification module (hereinafter, an‘identification device’) may be manufactured in a smart card type.Accordingly, the identification device may be connected to the mobileterminal 100 through the interface unit 160.

In addition, when the mobile terminal 100 is connected to an externalcradle, the interface unit 160 may be a passage through which power issupplied from the cradle to the mobile terminal 100 or a passage throughwhich various command signals input from the cradle by the user aredelivered. The various command signals or the power input from thecradle may operate as signals for perceiving that the mobile terminal100 is accurately mounted in the cradle.

The memory 170 may store a program for operations of the controller 180and temporarily store input/output data (e.g., a phone book, messages,still images, videos, etc.). The memory 170 may store data aboutvibrations of various patterns and sounds at the time of a touch inputon the touch screen.

The memory 170 may include at least one storage medium type among aflash memory type, a hard disk type, a Solid State Disk (SSD) type, aSilicon Disk Drive (SDD) type, a multimedia card micro type, a card typememory (e.g., SD or XD memory, etc.), a random access memory (RAM), astatic random access memory (SRAM), a read-only memory (ROM), anelectrically erasable programmable read-only memory (EEPROM), aprogrammable read-only memory (PROM), a magnetic memory, a magnetic diskand an optical disc. The mobile terminal 100 may operate in relation toa web storage performing a storage function of the memory 170 over theinternet.

Furthermore, as described above, the controller 180 normally controlsoverall operations and an operation related to an application program ofthe mobile terminal 100. For example, when a state of the mobileterminal satisfies a set condition, the controller 180 executes orreleases a lock state that limits an input of a user's control commandto applications.

In addition, the controller 180 can perform a control or a processrelated to a voice call, data communication, or a video call, etc., ormay perform a pattern recognition processing for recognizing a writteninput and a drawing input performed on the touch screen as a characterand an image, respectively. Furthermore, the control 180 may combine andcontrol any one of or a plurality of the above-described elements inorder to implement various embodiments to be described below in themobile terminal 100.

The power supply unit 190 receives external or internal power under acontrol of the controller 180 and supplies power necessary for operatingeach element. The power supply unit 190 includes a battery. The batterymay be an embedded battery that is rechargeable and may be detachablycoupled for charging. The power supply unit 190 may include a connectionport, and the connection port may be configured as an example of theinterface 160 to which an external charger providing power iselectrically connected for charging the battery.

As another example, the power supply unit 190 may be configured tocharge the battery in a wireless manner without using the connectionport. In this instance, the power supply unit 190 may receive, from anexternal wireless power transmitting device, power by using one or moreof an inductive coupling manner based on a magnetic induction phenomenonand a magnetic resonance coupling manner based on an electromagneticresonance phenomenon.

Hereinafter, various embodiments may be implemented in a recordingmedium that is readable with a computer or a similar device by usingsoftware, hardware, or a combination thereof.

Next, description is made about a communication system realizablethrough the mobile terminal 100 according to an embodiment. Firstly, thecommunication system may use different wireless interfaces and/or aphysical layer. For example, the wireless interface available by thecommunication system may include Frequency Division Multiple Access(FDMA), Time Division Multiple Access (TDMA), Code Division MultipleAccess (CDMA), Universal Mobile Telecommunications Systems (UMTS) (inparticular, Long Term Evolution (LTE), or Long Term Evolution-Advanced(LTE-A)), Global System for Mobile Communications (GSM), or etc.

Hereinafter, for convenience of explanation, description is madelimitedly to CDMA. However, it is obvious that the embodiments may beapplied to all communication systems including an Orthogonal FrequencyDivision Multiplexing (OFDM) wireless communication system as well as aCDMA wireless communication system.

The CDMA wireless communication system may include at least one terminal100, at least one base station (BS, also may be referred to as Node B orEvolved Node B), at least one BS controller (BSC) and a mobile switchingcenter (MSC). The MSC may be configured to be connected to the PublicSwitched Telephone Network (PSTN) and BSCs. The BSCs may be connected tothe BS in pair through a backhaul line. The backhaul line may beprepared according to at least one selected from E1/T1, ATM, IP, PPP,Frame Relay, HDSL, ADSL, and xDSL. Accordingly, the plurality of BSCsmay be included in a CDMA wireless communication system.

Each of a plurality of BSs may include at least one sector, and eachsector may include an omni-directional antenna or an antenna indicatinga specific radial direction from the BS. In addition, each sector mayinclude two or more antennas having various types. Each BS may beconfigured to support a plurality of frequency allocations and each ofthe plurality of allocated frequencies may have specific spectrum (e.g.,1.25 MHz, or 5 MHz).

An intersection between the sector and the frequency allocation may becalled as a CDMA channel. The BS may be called as a base stationtransceiver subsystem (BTSs). In this instance, one BSC and at least oneBS are called together as a “base station”. The base station may alsorepresent a “cell site”. In addition, each of a plurality of sectors fora specific BS may also be called as a plurality of cell sites. Abroadcasting transmitter (BT) transmits a broadcast signal to terminals100 operated in a system. The broadcast reception module 1 illustratedin FIG. 36 is prepared in the terminal 100 for receiving the broadcastsignal transmitted by the BT.

Furthermore, in the CDMA wireless communication system, a globalpositioning system (GPS) may be linked for checking a location of themobile terminal 100. A satellite is helpful for grasping the location ofthe mobile terminal. Useful location information may be obtained by lessthan two or at least two satellites. Here, the location of the mobileterminal 100 may be tracked by using all techniques, which are capableof tracking the location, as well as a GPS tracking technique. Inaddition, at least one of GPS satellites may be selectively oradditionally responsible for transmitting satellite digital multimediabroadcasting (DMB).

The location information module 115 prepared in the mobile terminal 100is for detecting, operating or identifying the location of the mobileterminal 100, and may representatively include a GPS module and a WiFimodule. If necessary, the location information module 115 mayalternatively or additionally perform any function of other modules inthe wireless communication unit 110 for obtaining data for the locationof the mobile terminal 100.

The GPS module 115 may precisely calculate 3D current locationinformation according to latitude, longitude, and altitude bycalculating distance information from three or more satellites andprecise time information, and by applying a trigonometry to thecalculated information. A method is currently widely used thatcalculates location and time information using three satellites, andcorrects an error in the calculated location and time information usinganother satellite. The GPS module 115 may calculate speed information bycontinuously calculating a current location in real time. However, it isdifficult to precisely measure the location of the mobile terminal 100by using the GPS module in a dead zone, such as an indoor area, of thesatellite signal. Accordingly, in order to compensate for locationmeasurement in the GPS manner, a WiFi positioning system (WPS) may beused.

The WPS is a technique for tracking the location of the mobile terminal100 using a WiFi module prepared in the mobile terminal 100 and awireless access point (AP) transmitting or receiving a wireless signalto or from the WiFi module, and may mean a location measurementtechnique based on a wireless local area network (WLAN) using WiFi.

The WPS may include a WiFi positioning server, the mobile terminal 100,a wireless AP connected to the mobile terminal 100, and a databasestoring arbitrary wireless AP information. The mobile terminal 100connected to the wireless AP may transmit a location information requestmessage to the WiFi positioning server.

The WiFi positioning server extracts information on the wireless APconnected to the mobile terminal 100 based on the location informationrequest message (or a signal) of the mobile terminal 100. Theinformation on the wireless AP connected to the mobile terminal 100 maybe transmitted to the WiFi positioning server through the mobileterminal 100 or transmitted to the WiFi positioning server from thewireless AP.

The information on the wireless AP, which is extracted based on thelocation information request message of the mobile terminal 100, may beat least one selected from a MAC address, a Service Set Identification(SSID), a Received Signal Strength Indicator (RSSI), Reference SignalReceived Power (RSRP), Reference Signal Received Quality (RSRQ), channelinformation, Privacy, a Network Type, Signal Strength, and NoiseStrength.

As described above, the WiFi positioning server may receive informationon the wireless AP connected to the mobile terminal 100, and extractwireless AP information corresponding to the wireless AP to which themobile terminal is being connected from the pre-constructed database. Inaddition, information on arbitrary wireless APs, which is stored in thedatabase, may be information on a MAC Address, an SSID, channelinformation, Privacy, a Network Type, latitudinal and longitudinalcoordinates of a wireless AP, a building name and floor on which thewireless AP is located, indoor detailed location information (GPScoordinates available), an address of an owner of the wireless AP, aphone number, and etc. In addition, in order to remove a wireless APprovided by using a mobile AP or an illegal MAC address in the locationmeasurement process, the WiFi positioning server may extract apredetermined number of pieces of wireless AP information in thedescending order of an RSSI.

Thereafter, the WiFi positioning server may extract (or analyze)location information on the mobile terminal 100 by using at least onepiece of wireless AP information extracted from the database. Thelocation information of the mobile terminal 100 is extracted (oranalyzed) by comparing the stored and the received wireless APinformation.

As a method of extracting (or analyzing) location information on themobile terminal 100, a cell-ID method, a fingerprint method, atrigonometry, and a landmark method may be used. The cell-ID method is amethod of determining a location of a wireless AP having strongeststrength from among surrounding wireless AP information collected by amobile terminal. This method is advantageous in that implementation issimple, an additional cost is not necessary, and location informationmay be rapidly obtained. However, when installation intensity of awireless AP is lower, positioning precision becomes lowered.

The fingerprint method is a method of selecting a reference location ina service area, collecting signal strength information, and estimating alocation through signal strength information transmitted from a mobileterminal based on the collected information. In order to use thefingerprint method, it is necessary to construct a database forpropagation characteristics in advance.

The trigonometry is a method of operating a location of a mobileterminal based on a distance between coordinates of at least threewireless APs and the mobile terminal. For estimating the distancesbetween the mobile terminal and the wireless APs, signal strength isconverted into distance information, or a time of arrival (ToA) of awireless signal, a time difference of arrival (TDoA) of a wirelesssignal, an angle of arrival (AoA) of a wireless signal may be used.

The landmark method is a method of measuring a location of a mobileterminal by using a landmark transmitter. Besides the above-describedmethods, various algorithms may be used for extracting (or analyzing)location information on a mobile terminal. The location information onthe mobile terminal 100 extracted in this way may be transmitted to themobile terminal 100 through the WiFi positioning server and the mobileterminal 100 may obtain the location information.

The mobile terminal 100 may obtain location information by beingconnected to at least one wireless AP. In addition, the number ofwireless APs requested for obtaining the location information on themobile terminal 100 may be variously varied according to a wirelesscommunication environment in which the mobile terminal 100 is located.

The embodiments can also be embodied as computer readable codes on acomputer readable recording medium. The computer readable recordingmedium includes any kind of data storage devices that can store datawhich can be thereafter read by a computer system. Examples of thecomputer readable recording medium include hard disk drive (HDD), solidstate disk (SSD), read-only memory (ROM), random-access memory (RAM),CD-ROM, magnetic tape, floppy disk, and optical data storage device, anda carrier wave (such as data transmission through the Internet). Inaddition, the computer may include the controller 180 of the terminal.Therefore, the detailed description is not interpreted to be limited andshould be considered in all respects as illustrative. The scope of theinvention should be determined by reasonable interpretation of theappended claims, and all modifications within equivalent ranges of thepresent invention are included in the scope of the present invention.

According to various embodiments of the present disclosure, variousrequests from a user can be satisfied by obtaining a stretch criterionaccording to a direction of an applied force or a specific input and bystretching a display unit according to the obtained stretch criterion.

In addition, according to the present disclosure, user's convenience canbe improved by stretching a display unit to enable hidden informationbefore stretching to be displayed or displayed information beforestretching to be enlarged and displayed.

Although embodiments have been described with reference to a number ofillustrative embodiments thereof, it should be understood that numerousother modifications and embodiments can be devised by those skilled inthe art that will fall within the spirit and scope of the principles ofthis disclosure. More particularly, various variations and modificationsare possible in the component parts and/or arrangements of the subjectcombination arrangement within the scope of the disclosure, the drawingsand the appended claims. In addition to variations and modifications inthe component parts and/or arrangements, alternative uses will also beapparent to those skilled in the art.

What is claimed is:
 1. A stretchable display device comprising: adisplay unit configured to be stretched in at least one direction; asensing unit configured to sense information on a stretching forceapplied to the display unit; and a controller configured to: stretch thedisplay unit an amount corresponding to the stretching force applied tothe display unit, stretch an entire area of the display unit in responseto the stretching force being applied to the display unit without anarea designation input for designating a partial area of the displayunit to be stretched, and stretch the partial area of the display unitin response to the stretching force being applied to the display unitwith the area designation input being applied to the display unit. 2.The stretchable display device of claim 1, wherein the controller isfurther configured to stretch the entire area or the partial area of thedisplay unit in a same direction as the stretching force being appliedto the display unit.
 3. The stretchable display device of claim 1,wherein the controller is further configured to display additionalhidden content in a specific area stretched according to the stretchingof the display unit.
 4. The stretchable display device of claim 1,wherein the controller is further configured to return the display unitto a state before the stretching of the display unit when the forceapplied to the display unit is no longer sensed.
 5. The stretchabledisplay device of claim 1, wherein the controller is further configuredto zoom in or zoom out the content displayed on the display unitaccording to the force applied to the display unit in a z-axis directiondifferent than a stretching direction.
 6. The stretchable display deviceof claim 1, wherein the controller is further configured to fix thedisplay unit in a stretched state according to an application of a twistforce applied to the display unit.
 7. The stretchable display device ofclaim 1, wherein the area designation input includes a touch input onone point on the display unit, and wherein the controller is furtherconfigured to stretch the partial area of the display unit based on oneof x-axis and y-axis direction lines of the touch input and a directionof the force applied to the display unit.
 8. The stretchable displaydevice of claim 1, wherein the area designation input includes a touchpen input inputting a reference line on the display unit, and whereinthe controller is further configured to stretch the partial area of thedisplay unit based on the reference line and a direction of the forceapplied to the display unit.
 9. The stretchable display device of claim1, wherein the area designation input includes a folding of the displayunit, and wherein the controller is further configured to stretch thepartial area of the display unit based on a direction line correspondingto a folded part of the display unit and a direction of the forceapplied to the display unit.
 10. The stretchable display device of claim1, wherein the controller is further configured to only enlarge thecontent displayed on the partial area of the display unit according tostretching the partial area of the display unit.
 11. A method ofcontrolling a stretchable display device, the method comprising:stretching an entire area of a display unit of the stretchable displaydevice in response to a stretching force being applied to the displayunit without an area designation input for designating a partial area ofthe display unit to be stretched; and stretching a partial area of thedisplay unit in response to the stretching force being applied to thedisplay unit with the area designation input being applied to thedisplay unit.
 12. The method of claim 11, further comprising: stretchingthe entire area or the partial area of the display unit in a samedirection as the stretching force being applied to the display unit. 13.The method of claim 11, further comprising: displaying an additionalhidden content in a specific area stretched according to the stretchingof the display unit.
 14. The method of claim 11, further comprising:returning the display unit to a state before the stretching of thedisplay unit when the force applied to the display unit is no longersensed.
 15. The method of claim 11, further comprising: zooming in orzooming out the content displayed on the display unit according to theforce applied to the display unit in a z-axis direction different than astretching direction.
 16. The method of claim 11, further comprising:fixing the display unit in a stretched state according to an applicationof a twist force applied to the display unit.
 17. The method of claim11, wherein the area designation input includes a touch input on onepoint on the display unit, and wherein the partial area of the displayunit is stretched based on one of x-axis and y-axis direction lines ofthe touch input and a direction of the force applied to the displayunit.
 18. The method of claim 11, wherein the area designation inputincludes a touch pen input inputting a reference line on the displayunit, and wherein the partial area of the display unit is stretchedbased on the reference line and a direction of the force applied to thedisplay unit.
 19. The method of claim 11, wherein the area designationinput includes a folding of the display unit, and wherein the partialarea of the display unit is stretched based on a direction linecorresponding to a folded part of the display unit and a direction ofthe force applied to the display unit.
 20. The method of claim 11,further comprising: enlarging only the content displayed on the partialarea of the display unit according to stretching the partial area of thedisplay unit.